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1 12b.  DeTRBURON  0006 


1ft  AB»TRACTM*»«.w«ms 

Finite  word-length  adders  and  quantizing  methods  used  to  construct  digital  filters 
can  cause  non-linearities  to  occur  in  the  closed-loop  filter  system.  Such  non- 
linearities  can  degrade  system  performance  in  what  is  known  as  a  limit  cycle  behavior 
of  the  output.  Overflow  oscillations  are  limit  cycles  that  are  induced  by  the  re¬ 
peated  overflow  of  finite  word-length  adders  used  in  filter  realizations.  It  is 
possible  to  construct  digital  filters  that  are  free  of  overflow  oscillations.  Non¬ 
linear  analysis  techniques  can  be  used  to  derive  conditions  to  govern  digital  filter 
designs  that  will  be  free  of  overflow  oscillations.  This  paper  will  formulate  a 
general  theorem  to  ensure  that  nth  order  digital  filters  will  be  free  of  overflow 
oscillations.  An  implementation  of  digital  filters  with  two's  complement  arithmetic 
adders  is  included  to  demonstrate  the  result  of  the  analysis. 
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Abstract i  Finite  word-length  adders  and  quantising  Methods  used  to 
construct  digital  filters  can  cause  non-linearities  to  occur  in  the 
closed-loop  filter  aystesi.  Such  non-linearities  can  degrade  system 
performance  in  what  is  known  as  a  limit  cycle  behavior  of  the  output. 
Overflow  oscillations  are  limit  cycles  that  are  induced  by  the  repeated 
overflow  of  finite  word- length  adders  used  in  filter  realizations.  It 
is  possible  to  construct  digital  filters  that  are  free  of  overflow 
oscillations.  Non-linear  analysis  techniques  can  be  used  to  derive 
conditions  to  govern  digital  filter  designs  that  will  be  free  of 
overflow  oscillations.  This  paper  will  formulate  a  general  theorem  to 
ensure  that  nth  order  digital  filters  will  be  free  of  overflow 
oscillations.  An  implementation  of  digital  filters  with  two's 
complement  arithmetic  adders  is  included  to  demonstrate  the  result  of 
the  analysis. 

I)  INTRODUCTION 


Digital  filter  systems  are  implemented  using  finite  word-length 
arithmetic  adders.  Because  these  adders  are  physical  devices  of  finite 
precision  it  is  possible  for  overflow  to  occur  in  instances  when  large 
signals  are  added  together.  The  overflow  of  finite  precision  adders  is 
a  non-linear  operation.  For  repeated  overflow  the  output  of  the  filter 
can  result  in  periodically  recurring  values  that  form  a  limit  cycle. 

Stable  linear  digital  filters  can  be  designed  to  be  free  of 
overflow  oscillations.  Conditions  can  be  imposed  on  the  state  variable 
equation  of  the  linear  filter  to  ensure  that  overflow  non-linearities 
cannot  exist.  There  are  two  basic  approaches  to  the  analysis  which 
derive  such  conditions.  The  most  popular  approach  has  been  the  Lyapunov 
method.  The  other  approach  is  to  use  a  non-linear  frequency  domain 
criteria  similar  to  the  circle  or  Popov  criteria. 

Xn  1969,  Sber,  Mazo,  and  Taylor  [3]  presented  a  comprehensive 
investigation  of  limit  cycles  induced  by  adder  overflow.  They 
characterized  conditions  for  which  second  order  digital  filters  can 
remain  free  of  limit  cycles.  Xn  1978,  Mills,  Mullis,  and  Roberts  [1] 
were  able  to  extend  this  earlier  work  to  include  two  theorems  that 
guarantee  digital  filter  realizations  that  are  free  of  overflow 
oscillations.  Also,  in  1975,  Classen,  Mecklenbrauker,  and  Peek  [5]  used 
the  non-linear  frequency  analysis  criteria  to  develop  filters  that  do 
not  exhibit  limit  cycles. 


II)  LYAPUNOV  APPROACH  {1] 


A  stable  linear  digital  filter  can  be  represented  by  the  equation: 

X(t+1)  «  AX(t )  +  bu(t) .  (1) 

When  the  digital  filter  is  implemented  the  linear  filter  system  is 
imposed  with  non-linearities  and  becomes  the  non-linear  system  given  by: 

X(t+1)  -  P(X(t) ,u(t ) ] .  (2) 


The  state  space  of  the  digital  filter  can  be  described  as: 


(3) 


C  -  (XfcRn:  | XI |  <  1  for  each  i>. 

When  the  trajectories  of  the  1 inoar  filtar  ay a tan,  eq  (1),  r amain  inside 
the  atata  apaca  daacribad  by  C,  than  a  zaro- input  digital  filtar  bahavaa 
proparly,  that  is,  no  overflow  oacillationa  will  occur  at  tha  output  of 
tha  filtar.  However,  whan  tha  trajactoriaa  of  tha  filtar  ay atom  laava 
tha  atata  apaca  of  tha  filtar  ovarflow  oacillationa  can  occur  that  will 
induca  a  limit  eye la  behavior. 

Conaidar  tha  non-linaar  digital  filtar  modal  daacribad  by  Mills, 
Kullia,  and  Roberts: 

F(X,u)  -  H(AX  ♦  bu)  (4) 


whara 


|H(X) | i  ■  h(Xi)  (S) 

and  tha  non-linaar ity  h(*)  mu at  aatiafy  tha  conditiona: 

(i)  |h(v)|  <  1  for  all  v 

(ii)  h(v)  -  v  if  |v|  <  1.  (6) 

Thaaa  two  conditiona  imply  that 

|h(v)|  <  | v |  for  all  v.  (7) 

Thia  modal  ia  valid  whan  tha  non- 1 inaar ity  h(*)  ia  a  two' a  complement 
char act ariatic  and  tha  filtar  ia  given  in  ita  atata  variable  form. 
Conditiona  for  digital  filters  free  of  ovarflow  oacillationa  will  be 
developed  from  thia  nodal.  For  now  tha  affect  of  quantisation  errors 
will  be  neglected. 

For  u(t)  »  0  tha  digital  filtar  modal  reduces  to  a  zaro- input 
system.  The  zero- input  non-linear  filtar  system  can  ba  written  as: 

X(t+1)  -  H(AX(t)].  (8) 

Kills,  Kullia,  and  Roberts  have  derived  results  that  test  for  the 
existence  of  overflow  oscillations  and  provide  conditions  that  guarantee 
such  periodic  solutions  cannot  occur  in  digital  filtar  realisations. 
Their  results  are  stated  in  two  theorems  (see  also  Appendix): 

Theorem  It  If  there  exists  a  diagonal  matrix  D  with  positive 
elements  such  that  the  matrix  aquation  0  -  A 'DA  is  positive  definite 
then  overflow  oscillations  will  ba  Impossible.  Tha  only  periodic 
solution  of  tha  system 

X(t+1)  -  H(AX(t) ) 
is  the  identically  zero  solution. 


Theorem  2t  Theorem  2  gives  conditions  for  which  second-order 
digital  filters  will  ba  free  of  ovarflow  oacillationa.  For  a  2x2  matrix 
A  whose  eigenvalues  satisfy  I/)  |  <  1,  there  exists  a  positive  definite 
diagonal  matrix  D 
iff 

(i)  (al2) (a21)  >  0  (9) 

or  if  (al2)(a21)  <  0,  than 

(ii)  | all  -  a22|  +  dat(A)  <  1.  (10) 
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The  conditions  of  thaoran  2  can  bo  oxtondod  to  fora  a  aora  gonoral 
result,  For  an  nth  order  digital  filter  consider  theorem  3. 

Theorem  Jt  Tor  an  nxn  matrix  A  whose  eigenvalues  satisfy  |^|  <  1, 
there  exists  a  positive  definite  diagonal  matrix  0  iff 

(i)  Permutations  of  (aii)(ajj)  >  0  (11) 

for  i, j  ■  1,2,3, . . . ,n 

(ii)  (£.aii)2  +  2  £  (Permutations  of  (aii)(ajj))  (12) 

-"[dot (A)] 2  <  1. 


Tor  any  stable  linear  digital  filter  there  exists  a  two's 
complement  implementation  that  will  be  free  of  overflow  oscillations. 
Prom  the  Lyapunov  stability  theorem  it  is  known  that  the  unique  solution 
P  to  the  matrix  equation 

P"1  -  A* PA  +  I 

is  positive  definite.  If  T  is  a  symmetric  square  root  of 
P”1  then, 

p-1  .  i  _  (T-1AT) 'I(T"lAT) 

Hence,  the  coordinate  transformation  T  will  produce  a  new  A  that  will 
meet  the  conditions  of  theorem  1. 

Example  It 

From  theorem  2,  digital  filters  can  be  designed  that  are  free  of 
overflow  oscillations.  For  example,  consider  the  second-order  digital 
filter  of  figure  1  (2]t 


From  the  conditions  of  theorem  2,  the  filter  is  free  of  overflow 
oscillations  if: 

(al2)(a21)  •  -b2  >  0 


or  if 


(al2) (a21)  »  -b2  <0, 

then 

| all  -  a22 |  +  det(A)  »  bl  +  b2  <  1. 

Therefore,  overflow  oscillations  are  absent  if 

| bl |  +  | b2 |  <  1. 

This  example  shows  how  theorem  2  can  be  used  to  design  "direct  fora” 
digital  filters  (see  also  figure  2). 
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Ixample  2: 

Digital  filters  with  the  proparty  A' A  -  AA'  ara  cal lad  "normal" . 
Filters  of  normal  form  ara  fraa  of  overflow  oscillations;  this  is 
evident  form  thaoram  1.  Choosa  D  ■  I,  than  tha  conditions  for  which 
ovarflow  oscillations  cannot  occur  will  bo  satisfiad.  This  is  trua  from 
tha  spectral  proparty  of  normal  matricaa.  Tha  aiganvaluaa  of  1  -  A'A 
ara  <1  -^r> .  sines  A  is  stabla,  tha  aiganvaluaa  of  I  -  A'A  ara 
posit iva. 4  Banco,  tha  synmotric  matrix  Z  -  A'A  is  positivo  dafinita. 
Othar  important  faaturas  of  normal  filtars  is  thair  low  sansitivity  to 
parameter  quantisation,  low  round-off  noiaa,  and  thay  ara  invariant 
undar  fraquancy  transformation. 

III.  FREQUXNCY  AMALYSIS  APPROACH  [S] 

Again,  considar  tha  stabla  linaar  filtar  systam  dascribad  by 
aq(l).  In  tha  raalisation  of  this  filtar  quantizors  ara  usad  to  koap 
signals  form  oxcoading  tha  finito  precision  of  tha  practical  davieas 
used  in  tha  systam.  Quantisation  is  tha  truncation  or  rounding  of  a 
signal  to  an  arbitrary  precision.  Quantisation  of  signals  is  a  non¬ 
linear  operation  which  induces  limit  cycles  to  occur  in  tha  closed-loop 
filtar  systam.  Tha  modal  for  digital  filtars  with  quantization  errors 
is  shown  in  figure  3.  Tha  non- linaar  systam  has  a  linaar  part  W  and  a 
non-linearity  Q.  Claasen,  Mecklenbruakar,  and  Peak  have  usad  fraquancy 
analyeis  techniques  similar  to  tha  Popov  and  circle  criteria  to  develop 
conditions  for  which  zero- input  digital  filtars  will  be  fraa  of  limit 
cyclaa.  Thair  results  extend  tha  earlier  work  dona  by  A. I.  Barkin  in 
1970  (6]. 

If  tha  non-linearity  Q  is  a  sector  bounded  non-linearity  specified 
by  (aaa  also  figure  4) t 

Q(0)  •  0  (13a) 

and 


0  <  <  k,  for  all  x  4  0  (13b) 

than  conditions  can  be  derived  on  tha  state  variable  aquation  of  a 
digital  filtar  to  ensure  that  limit  cycles  will  not  occur  in  tha  zero- 
input,  closed- loop  filter  systam.  A  number  of  theorems  ara  presented  by 
Claasen,  Mecklenbruakar,  and  Paak  to  summarize  these  conditions.  Tha 
appendix  contains  proofs  of  tha  thsorasw. 

Theorem  4:  For  a  digital  filtar  systam  with  a  non-linearity  given 
by  aquation  (1),  with  linaar  part  W(Z)  which  is  finite  for  |z|  *1,  and 
sector  non-linearity  that  satifies  aquations  (13a)  and  (13b),  than  limit 
cycles  of  length  L  ara  absent  if: 

Re{W(Zl) }  -  1/k  <  0  for  1  -  0,1,..., L/2  (14) 


Z1  »  exp  { j  (2TT/L)  1} . 

To  apply  theorem  4  considar  the  following  example: 


Bxample  3: 
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For  implamentat ion  of  ths  filtor  system,  choose  tho  quantiser  such 
that  for  k  ■  1  truncation  occurs  and  for  k  ■  2  rounding  occurs,  than  for 
tho  digital  filtor  shown  in  figuro  5, 

*I(Z)  -  (bl)*"1  ♦  (b2)s“2 


and 


Jte{W(Z)}  -  (bl)cos(  (2ir/L)l]  +  (b2)cos[  (2tr/L)l] . 

Limit  cyclos  of  longth  L  «  1  cannot  exist  if 
bl  +  b2  -  l/k  <  0. 

Moroovor ,  all  limit  cyclos  aro  absent  from  tho  digital  filtor  system  if 

(bl)cos(#)  +  (b2)cos(d)  -  l/k  <0,  0  <  #  <  2  (15) 

Those  results  aro  shown  in  figure  6a.  Filtor  coefficients  chosen  in  tho 
shadad  area  will  guarantee  a  filter  that  is  free  of  limit  cycles. 

The  remaining  theorems  will  extend  the  concept  put  forth  by 
theorem  4.  By  imposing  extra  constraints  on  the  non-linearity  of  the 
system  a  greater  nusriaer  of  coefficients  can  be  selected  to  provide 
filters  that  are  absent  of  limit  cycles. 

Theorem  J:  For  a  system  with  a  non-linearity  that  satisfies  the 
conditions  of  equation  (13)  and  the  additional  constraint: 

<Q<*+h)  -  Q(x) }  hiO,  for  all  x,h  (16) 

if  there  exists  an  a  >  0  such  that  1  -  0,1 , ...,L/2  and 

Re{W(zl) (1  +  a(l  -  ZIP)]}  -  l/k  <  0  (17) 

where  Z  -  axp(  j  (2ir  /L)l] ,  then  limit  cycles  of  length  L  will  be  absent. 
Figure  6b  shows  all  possible  filter  coefficients  that  satisfy  the 
conditions  of  the  theorem. 

Theorem  6:  For  a  system  with  a  symmetric  non-linearity 
characteristic  that  also  satisfies  the  conditions  of  equations  (13)  and 
(16)  if  there  exists  sosw  arbitrary  constants  a,b  >  0  such  that  for  1 
m  0,1,... ,L/2 

Re{W(Zl) [1  +  (a(l  -  ZIP)  +  b(l  +  ZIP))]}  (18) 

-  l/k  <  0 

were  Z1  *  exp  {j(2ff/L)l},  then  limit  cycles  of  length  L  cannot  exist. 
Figure  6c  shows  the  possible  filter  coefficients  that  will  satisfy  the 
conditions  of  the  theorem. 

the  symmetric  non-linear  characteristic  of  theorem  6  implies  that 
Q(-x)  «  -Q(x). 

To  apply  the  results  of  theorems  5  and  6  it  is  necessary  to  use  linear 
programming  techniques  to  find  solutions  for  the  filter  coefficients. 

In  each  of  the  new  theoresw  it  is  important  to  note  that  with  additional 
constraints  imposed  on  the  non-linearity  of  the  system  a  larger  number 
of  filter  realisations  exist  that  cannot  have  limit  cycles.  The  next 
set  of  theorssM  will  generalise  the  results  of  this  section. 

Zn  practice  digital  filter  systesw  can  contain  several  non- 
linearities.  It  is  possible  to  model  such  systems  by  extending  the 
results  of  the  previous  theorems.  Ths  sector  boundary  condition  of  each 
non-linearity  is  arbitrary  such  that  the  following  conditions  ars  valid: 
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Qn(0)  -  0 


(19) 


0  <  <  kn,  for  every  *  ■  0.  (20) 

Th*  next  Mt  of  theorems  will  bo  developed  from  these  contrainta. 

Theorem  7:  For  a  ayataa  with  n  non-linaaritiae  that  aatiafy  tha 
condition*  of  aquations  (19)  and  (20)  if  for 
1  **  0,1,..., L/2  th*  Hanoi ti an  part  of 

W(Z1)  -  diaq(l/k)  (21) 

ia  negative  dafinita,  than  limit  cyclaa  of  langth  L  cannot  axiat. 

Theorem  Ft  For  a  ayataa  with  n  non-linaaritiaa  aatiaifing  tha 
condition*  of  aquation*  (19)  fi  (20)  and  tha  additional  eonatraint  that: 

{Q(x+h)  "  Q(x))h  0,  for  ovary  x,h  (22) 

if  for  1  -  0,1,..., L/2  and  tha  Haraitian  part  of 


{1  +  diag(  (a(l  -  ZIP)  +  h(l  ♦  ZlP)]}W(Zl)  (23) 

-  diag(l/k) 

ia  nagativ*  dafinita,  than  liait  cyclaa  of  langth  L  cannot  axiat. 

For  nth  ordar  digital  filtara  with  n  non-linaaritiaa  thaoraa  4  can 
b*  uaad  to  dataraina  tha  filtar  coaff icianta  that  would  allow  th*  ayataa 
to  b*  fro*  of  liait  cyclaa.  Consider  th*  second-order  filtar  shown  in 
figure  7.  Sine*  tha  linear  part  iat 


W(Z1) 


fa*"1  a*”1” 

|b*“2  b*“2 


th*  Haraitian  part  of  H(Z1)  -  (l/k)X  is  given  by: 


(1/2) 


Ex”1  +  as  - 
as  +  b*"3 


a*”1  +  b*2 
b*"2  +•  b*2  -  2/k 


For  tha-  filter  to  be  fra*  of  liait  cyclaa  of  any  langth  tha  Haraitian 
matrix  given  in  eq(24)  bocoaas 


(1/2) 


2acoa(  )  -  2/k  M-j  +  b#j2 
2a mi  +  b*”32  2bcos(2  )  -2/k 


which  ia  negative  dafinita  for  (X  <2.  Figure  8  shows  tha  possible 
coaff icianta  that  satisfy  this  condition. 


SUMMARY 


Whan  finite  word-length  adders  are  used  to  implement  digital 
filtar  designs  non-linaaritiaa  can  occur  in  th*  closed-loop  filtar 
system.  These  non-linaaritiaa  are  caused  by  the  overflow  that  can  occur 
during  tha  addition  operation.  Limit  cycles  induced  by  th*  repeated 
overflow  of  finite  word-length  adders  are  called  overflow  oscillations. 

It  is  possible  to  construct  digital  filters  that  are  fra*  of 
overflow  oscillations.  Mills,  Mullis,  and  Roberts  established  a  sat  of 
theorems  to  determine  th*  existence  of  such  liait  cycles  and  provided 
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conditions  to  sliainsts  limit  cycles  from  ths  filter  realizations. 

Also,  they  reported  that  a  class  of  digital  filters  exists  that  will  not 
supprot  limit  cycle  behavior.  Filters  with  the  special  property 
AA*  «  A'A  are  free  of  limit  cycles.  Filters  of  this  design  are  called 
normal  digital  filters. 

The  non-linear  operation  associated  with  quantisation  can  cause 
limit  cycles  to  persist  in  the  closed-loop  filter  system.  Classen, 
Mecklenbrauker ,  and  Peek  used  frequency  analysis  techniques  similar  to 
the  Popov  and  circle  criteria  to  derive  conditions  for  which  digital 
filters  will  be  free  of  limit  cycles.  Their  results  were  generalized  by 
the  author  to  provide  conditions  for  nth  order  filters  that  will  be  free 
of  the  limit  cycle  behavior. 


APPENDIX! 

this  appendix  contains  the  proofs  of  the  theorems  presented  in 
this  paper. 


A)  Theorem  It 
proof t 


Consider  a  zero-input  digital  filter;  u(t)  -  0.  The  non-linear 
filter  system  is  a  composition  of  two  parts;  a  linear  part  X(t)  -  AX(t) 
and  the  application  of  the  overflow  non-linearity  h(*)  on  the  vector 
AX(t) .  The  existence  test  involves  finding  a  norm  under  which  each 
operation  is  norm  decreasing.  That  is, 

{ |ax| |  <  r | | X | |  for  all  X  with  r  <  1  (Al) 

I |H(X) | |  £  | |x| |  for  all  X  (A2) 

If  these  conditions  are  true,  then  it  follows  that  the  zero-input 
trajectories  of  the  non-linear  filter  system 

X(t+1)  -  H[X(t ) ,u(t ) ] 

tend  to  zero  exponentially  fast,  that  is 

ll*<t)j|  *  rt||x(0,||. 

Hence,  the  only  periodic  solution  to 

X(t+1)  -  H( AX(t ) j 

is  the  identically  zero  solution. 

For  a  quadratic  norm  defined  by 

I | X | J  ■  tX*DXJ1/2, 

where  X'  denotes  the  transpose  of  the  matrix  X, 

in  order  for  equation  (A2)  to  be  true,  for  all  overflow  characteristics 
h( * ) ,  the  matrix  D  must  be  necessarily  diagonal.  This  condition  is  also 
sufficient  since, 

||h(X)||  -  £<dii)  g(xi)2 

-  JJl  (dii)  xi2 
#»• 

-  Il*ll2. 
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Than,  for  aquation  (A2)  to  ba  trua,  it  ia  nacasaary  and  aufficiant 
that  tha  matrix 

Q  «  D  -  A’ DA 

ba  posit iva  dafinita,  ainca 

r2 1 1 X 1 1 2  -  1 1 AX |  |  -  X*  [Q  -  (l-r^DJX. 

If  Q  ia  poaitiva  dafinita  than  so  ia  Q  -  { 1-r2 )D  for  r  sufficiantly 
elosa  to  unity.  Tharafora,  tha  contitions  of  tha  thaoram  ara  valid  iff 
thara  is  a  diabonal  matrix  0  with  poaitiva  diagonal  alamanta  such  that 
tha  matrix  0  -  A' DA  is  poaitiva  dafinita. 


B)  Thaoram  2: 
proof: 


It  thara  axists  a  poaitiva  diagonal  matrix  D  such  that  D  -  A 'DA  ia 
poaitiva  dafinita  than  thara  also  axists  a  non-singular  diagonal  matrix 
T  for  which  I-  M  is  poaitiva  dafinita,  whara 

M  -  (T“^AT) ' (T-1AT) . 

Tha  matrix  (I  -  M)  ia  poaitiva  dafinita  iff  tha  Tr(I  —  M)  is  poaitiva 
and  tha  dat(X  -  M)  ia  poaitiva  (ia  tha  aiganvaluas  of  (Z  -  M)  ara 
poaitiva) .  Considar, 

dat(I  -  M)  ■  dat(sX  -  M)  for  s  •  1 

-  1  -  Tr (M)  ♦  dat(M) 

»  1  -  Tr (M)  +  Cdat(A)]2 
Tr(I  -  M)  »  2  -  Tr (M) 

>  1  +  (dat(A)]2  -  Tr (M)  -  dat (X  -  M) 

So,  conaidar  only  tha  dat (I  -  M) . 

dat (X  -  M)  »  dat (A)  (A3) 

-  (all2  +  al22  +a212/t  +  a222] 

whara  e  *  T22/T11.  Maximizing  tha  right  hand  sida  of  (A3)  with  raspact 
to  t  yialds  tha  inaquality: 

dat (X  -  M)  <  1  +  [dat (A) ]2  (A4) 

-  (all2  +2(al2) (a21)  +  a222] 

-  [I  ♦  dat(A)]2  (A5) 

-  [Tr (A) ]2  +  2<al2)(a21)  -  | (al2) (a21) | ) 

If  tha  right  hand  sida  of  (A5)  is  poaitiva  than  tha  ocnditions  of 
thaoram  2  ara  valid.  Xf  (al2  a21)  >  0  than  tha  right  hand  sida  is  tha 
product  of  (1  +  Tr (A)  +  dat(A)](l  -  Tr (A)  +  dat(A)].  Bbart,  Mazo,  and 
Taylor  hava  shown  this  quantity  to  ba  poaitiva  [3].  If  (al2  a21)  <  0, 
than  tha  right  hand  sida  of  aquation  (A5)  isi 
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1  ♦  [dat (A) ]2  -  (all2  -  2<al2)(a21)  ♦  a222] 

-  [1  -  dat (A) ]2  -  (all  -  a22)2. 

This  quantity  is  positive  definite  iff  |all  -  a22 |  +  dat(A)  <  1. 
Tharafora,  tha  conditions  of  thaoram  2  ara  valid. 

C)  Thaoram  3: 
proof : 


Tha  proof  of  thaoram  3  follows  form  tha  proof  of  thaoram  2. 

If  thara  axists  a  positiva  dafinita  diagonal  matrix  D  such  that  D 
-  A 'DA  is  positiva  dafinita  than  thara  also  axists  a  non-singular 
diagonal  matrix  T  for  which  tha  matrix  (I  -  M)  is  positiva  dafinita, 
whara 


M  -  (T"*AT) ' (T“^AT) 

Tha  matrix  (I  -  M)  is  positiva  dafinita  iff  Tr(I  -  M)  is  positiva  and 
dat(X  -  N)  is  positiva.  Consider, 

dat (I  -  M)  -  1  -  Tr (M)  +  (det(A)]2 
-  Tr(I  -  M). 

In  terma  of  tha  elements  of  T, 

dat (I  -  M)  -  1  ♦  [dat (A) J2  -  (  aii)2  -  (T22/Tll)al22 

-  (T33/Tll)al32  -  ...  -  (Permutations  of 

(Tii/Tj j ) (aii) (aj j ) ) 

Maximise  tha  right  hand  side  with  respect  to  each  Tii/Tj j  than, 

dat (I  -  M)  »  (1  ♦  dat (A) ]2  -  [Tr(A)j2 
+  ( ^Permutations  of 

[ (aii) (*j j )  -  | (aii) (aj j ) | ] ) . 

If  each  (aii  ajj)  >  0,  than  from  tha  proof  of  theorem  2;  (1  ♦  dat (A)]  - 
[Tr (A) ]  is  a  positiva  quantity,  if  aach 
(aii  ajj)  <  0,  than  dat (I  -  M)  is  positiva  if 

1  >  (&aii)2  +  2{  1  [Permutations  of  (aii)  (ajj)  ]> 

-  [dat (A)]2. 


D)  Theorem  4t 
proofs 


Claasan,  Mecklanbraukar ,  and  Peak  used  tha  proof  from  A. I.  Barkin 
to  develop  the  proof  for  thaoram  4.  From  Barkin,  tha  following 
summation  was  used: 

p  -  (2/L)<t£Q(Xn)[Xn  -  (1/X)  (Q(Xn) ) ) }.  (A6) 

««• 

This  function  describe  a  zero-input  digital  filter  system.  Since  tha 
system  non-linaarity  satisfies  tha  oenditions  of  aquation  (13),  than 

(A7) 


p  >  0. 
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The  proof  of  this  thsorsm  is  by  contradiction.  Suppose  that  X  is 
periodic  with  period  length  L.  From  Parseval's  theorem  equation  (A6) 
can  be  transformed  into  a  Fourier  representation! 


irl 


P  -  £<Y*1)[X1  -  (l/k)(Yl)]. 
i»o 

Also,  the  non-linear  system  is  given  ast 
XI  -  W(Z1)  Tl. 


(A8) 


(A9) 


So,  from  equations  (A7)  and  (A8), 

P  -^|Yl|2[W(Zl)  -  1/k]. 

■f*o 

This  sum  is  always  negative,  which  contradicts  equation  (A7),  hence 
limit  cycles  of  length  L  cannot  exist. 


8)  Theora 
proof: 


S: 


The  proof  of  this  theorem  is  an  extension  of  the  proof  of  theorem 
4.  Consider  the  summation: 

p<al,...,an)  -  <2/N){£Q(Xh)  (Xn  -  (1/k)  Q(Xn)  ]  (A10) 

Q(Xn)  [Xn  -  Xn+p]>. 

The  proof  of  this  theorsm  is  oy  contradiction.  Suppose  that  X  is 
periodic  with  period  of  length  L.  The  first  term  of  the  function  is 
always  positive.  This  is  a  result  taken  from  Barkin  [6].  The  second 
term  can  be  shown  to  be  of  the  same  form  as  the  first  term, 

psp  »  ZL  Q ( Xn )  (Xn  -  Xn+p) 
itso 

m*jL  Cq ( Xkp+l )  (Xkp+1  -  Xkp+p+i) 

*  jL  Q(Xk(p,i) )  (Zk(p,i)  -Zk+l(p,i)], 

hence  from  Barkin  this  term  is  also  positive.  Therefore,  it  has  been 
shown  that  p(al,...,an)  is  positive.  Apply  Parseval's  theorem  to  the 
function  of  eq  (A10).  The  result  is: 

*5*  t-i 

p  "  fcJY1|2  IR*(W(21) )  {1  +£  k(l  -  ZP)}  -  (1/k)]  (All) 

’*•  ft/ 

If  it  is  possible  for  limit  cycles  to  occur  then  the  right  hand  side  of 
equaiton  (A10)  is  always  negative,  which  is  a  contradiction.  Therefore, 
limit  cycles  ov  length  L  cannot  exist  under  the  conditions  of  specified 
by  this  theorem. 


F)  Theorem  6: 
proof: 

Vox  the  proof  of  this  theorem  add  the  term: 
i-J  l- I 

1  b  [  lQ(Xn)  (Xn  +  Xn+p)] 

to  the  function  specified  in  equaiton  (A10).  Now  it  is  necessary  to 
show  that  htis  new  term  is  non-negative  for  the  abritrary  constant  b  > 


0.  Tha  inaqua lity  givan  by  aquation  (18)  la  darivad  by  applying 
Paraaval'a  thaoram  to  tha  naw  function  p(al, . . . , an) . 

Tha  tarn 

Sp  -  £g(Xn)  (Xn  ♦  Xn+p) 


im  ■uv«r 

Vi' 


can  ba  ahown  to  ba  tha  ai 

_ [Q(Zk(p,i))  (Zk(p,i)  -  Zk+l(p,i)]. 


(A12) 


Again,  fora  Barkin  thia  tarn  ia  alwaya  non-nagativa,  hanca  tha  naw 
funciton  will  alao  alwaya  ba  non-nagativa.  Tharafora,  for  tha 
conditiona  apacifiad  in  thaoram  6,  limit  cyclaa  of  langth  L  cannot 
axiat. 


6)  Thaoram  7: 
proof: 


Conaidar  tha  function  of  aquation  (A6),  axcapt  that  n  non- 
linaaritiaa  ara  introducad,  aquation  (A6)  bacomaa: 
i.-l 

pn  -(2/L)  {£on(Xmn)  (Xmn  -  (1/k)  (^(Xm**) ) }  (A13) 

#*• 

From  tha  proof  of  thaoram  4  it  followa  that 
pn  >  0. 

Thia  maana  that  '■'.ha  aum  ovar  tha  numbar  of  non-linaaritiaa  of  pn  ia  non- 
nagativa.  Tha  •'/coot  of  thia  thaoram  ia  by  contradiction.  Suppoaa  that 
X  ia  pariodic.  Racall  that  for  tha  non-linaar  ay at am: 

X  -  W<Z1)  Y.  (A14) 


So,  applying  Paraaval'a  thaoram  to  tha  function  and  from  aquation  (A14) 
a  aimilar  raault  to  thaoram  4  ia  obtainad: 


p  -  £ Yi  (-  diag(l/kn  ♦  W<Z1)] 
♦  *« 


for 


A(Z)  «  -  diag(l/km)  +  W(Z) 

it  followa  that  p  ia  negativa  dafinita  ainca  tha  Haraitian  part  of  A(Z) 
ia  nagativa  for  all  1.  Thia  ia  a  contradiction  to  tha  pravioua 
atatamanta.  Tharafora,  limit  cyclaa  cannot  axiat  undar  tha  conditiona 
of  thaoram  7. 


H)  Thaoram  8: 
proof: 


Tha  proof  of  thaoram  8  followa  from  tha  proof a 
4.  Adding  tha  tara: 

L»l 

(W(Z)  -  diag(l/kn) )  Idiag(^.{a(  1  -  ZP)  +  b(l 

to  aquation  (21),  it  ia  nacaaaary  to  ahow  that: 

4.-1 

£.<a(l  -  ZP)  +  b(l  -  ZP) 


of  thaorama  3  and 


-  Zp)})J 


11 


is  positive  definite  for  ths  srbritsry  constants  a,  b  >  0,  and  tha 
symmetric  non-linearity  of  ths  syatasi.  Sines  if  ths  abova  function  is 
positivs  dsfinits  for  ths  givsn  conditions  than  from  thsoram  4  limit 
cyclss  cannot  sxist  undar  ths  constraints  of  thsorsa  5. 
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Figure  2a.  Components  of  the  digital  filter  realization: 

a)  Serial  two's  complement  adder; 

b)  Serial  Multiplier  [4] 
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Figure  2b.  General  Second-order  digital  filter 
(hardware  implementation)  [4]. 


Figure  5.  Second-order  digital  filter  with  one  nonlinearity. 


H-* 


Figure  7.  Second-order  digital  filter  with  two  nonlinearitiee. 
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